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FOREWORD 





This  semi-annual  technical  report  presents  the  accomplishments  of 
this  project  during  the  period  of  1 June  1974  through  30  November  1974. 
Since  the  inception  of  this  project,  it  has  been  the  resul+  of  the 
collaborative  efforts  of  many  individuals.  Most  of  the  staff  members 
contributed  to  the  making  of  this  report. 


Biocybernetic  Factors  in  Human  Perception  and  Memory 

SUMMARY 

The  goal  of  this  research  project  is  to  develop  biocybernetic 
concepts  and  techniques  useful  for  the  analysis  and  development  of  skills 
needed  tor  the  enhancement  of  concrete  images  of  the  "eidetic"  type. 

We  treat  scanpaths  of  the  eye  during  observation  of  visual  patterns 
as  indicators  of  the  brain's  strategy  for  the  intake  of  visual  information. 
We  attempt  to  determine  the  features  that  differentiate  visual  scanpaths 
associated  with  superior  imagery  from  scanpaths  associated  with  inferior 
imagery,  and  simultaneously,  to  differentiate  the  electroencephalographic 
features  correlated  with  superior  imagery  from  those  correlated  with 
inferior  imagery.  Incorporating  this  information,  we  shall  design  and 
implement  a closely-coupled  man-machine  system  to  generate  image  enhance- 
ment and  to  train  the  individual  to  exert,  greater  voluntary  control  over 
his  own  imagery.  Significant  progress  has  been  made  in  this  reporting 
period. 

We  believe  that  he  strategy  of  an  individual  with  superior  imagery 
is  to  fixate  his  eyes  ai  optimal  positions  of  the  visual  pattern  at 
optimal  time  instants  in  relation  to  KEG.  Our  study  of  the  visual 
scanpaths  while  viewing  a stationary  scene  and  the  development  of  an 
EKG  model  is  aimed  at  obtaining  a firmer  grip  of  these  optimal  locations 
and  optimal  time  instants.  We  have  also  developed  models  for  saccadic 
eye  movement  for  the  purpose  of  providing  more  accurate  prediction  of 
eye  positions  and  tracking  of  eye  movements.  Some  recent  results  are 
presented  in  this  report  and  at  various  international  and  national 
scientific  conferences. 
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The  implications  of  this  research  project  are  signficant  for  the 
Department  of  Defense  since  xhe  results  obtained  from  this  research 
will  enhance  the  potential  for  devising  new  techniques  that  will  permit 
the  development  of  the  required  skills  for  stronger  imagery  in 
individuals  with  normal  memories.  Because  it  is  an  important  asset  for 
the  military  person  to  have  the  ability  to  absorb  information  rapidly, 
to  retain  it  intact  for  long  periods  of  time,  and  to  recall  it  instantly 
when  needed,  in  this  project  we  strive  to  intensify  the  post-stimulus 
imagery  as  far  as  possible  towards  "eidetic"  memory  and  to  search  out 
those  features  of  successful  retrieval  strategies  so  as  to  strengthen 
the  individual's  redintegration  power. 
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I.  INTRODUCTION 
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The  development  and  use  of  biocybernetic  concepts  and  techniques 
for  analyzing  and  developing  skills  essential  for  the  enhancement  of 
concrete  images  of  the  "eidetic"  type  are  the  major  concerns  of  this  pro- 
ject. Our  effort  has  been  concentrated  on  the  problem  of  achieving 
biocybernetic  expansion  of  visual  memory  by  using  a closely-coupled 
man-machine  system  which  performs  real-time  monitoring,  analysis, 
and  feedback  of  spatial  and  temporal  cues  that  play  prominent  roles 
in  human  memory  encoding  and  retrieval.  There  exists  strong  evidence 
that  the  human  nervous  system  depends  upon  these  cues  in  memory  encoding 
and  recall,  especially  sensory  images.  The  limited  knowledge  of  human 
memory  mechanisms  has  hampered  our  design  of  the  closely-coupled  man- 
machine  system.  We  shall  use  this  man-machine  system  for  the  measurement 
and  prediction  of  human  mnemonic  performance  as  well  as  for  the  control 
and  enhancement  of  mnemonic  skills.  Such  a man-machine  system  for 
visual  memory  tracking  and  training  was  block  diagramed  in  the  previous 
technical  report. 

The  main  scheme  is  to  develop  and  implement  real-time  techniques 
for  monitoring  and  prediction  of  central  nervous  activities  related 
to  memory  functions  through  the  analysis  and  tracking  of  eye  movements 
and  EEG  signals.  The  information  thus  gained  in  the  analysis  of  the 
cortical  activities  ill  then  be  used  to  arrange  extraordinary  conin- 
cidences  between  eye  pointing,  cortical  states,  and  the  control  of 
stimulus  patterns  by  employing  optimal  control  schemes.  The  visual 
stimuli  are  presented  in  various  ways  such  as  projection  screen, 
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oscilloscopic  displays,  and  GRAF/PEN  system  for  dichopic  or  monopic 
viewing.  By  measuring  eye  positions,  eye  movements,  and  EEG  signals 
we  intend  to  obtain  the  optical  and  electrophysiological  estimators 
useful  for  deciphering  the  cues  that  serve  as  keys  to  the  encoding 
and  recall  of  visual  memory.  Combining  these  techniques  with  various 
feedback  schemes  to  close  the  control  loop  in  our  closely-coupled  man- 
machine  system,  we  are  attempting  to  achieve  tighter  control  over  image 
persistence  and  image  dissipation.  In  this  man-machine  system,  we  use 
computer-based  models  to  predict;  i.e.,  forward-time  analysis,  the  kind 
of  stimulus  patterns  which  should  be  used  in  order  to  produce  the 
desired  future  response.  The  eye-movement  and  EEG  signal  are  the 
responses  through  which  the  cortical  states  are  monitored.  These 
responses  are  closely  controlled  since  the  models  are  designed  to  mimic 
the  actual  physiological  processes  as  far  as  the  stimulus-response 
relation  is  concerned.  Significant  progress  has  been  made  on  the  modeling 
of  saccadic  eye  movements  and  EEG  signals  in  the  past  half  year.  The 
closely-coupled  nan-machine  system  is  being  implemented  on  a PDP-15 
computer.  The  necessary  interface  hardware  and  software  have  been 
designed  and  implemented  by  us.  Our  major  task  now  is  to  close  the 
feedback  loop  in  this  man-machine  system.  Accomplishments  made  towards 
this  end  will  be  described  in  this  technical  report. 

Our  effort  has  been  concentrated  on  modeling  of  saccadic  eye 
movements  and  EEG  signals,  and  the  determination  of  spatial  cues 
that  are  keys  to  the  encoding  and  retrieval  of  visual  memory.  In 
the  next  section,  we  shall  describe  methods  for  modeling  and  prediction 
of  saccadic  eye  movements  with  the  aim  to  obtain  better  eye-movement 
tracking.  Preliminary  results  are  very  encouraging.  In  order  to 
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differentiate  the  visual  scanpaths  associated  with  superior  (eidetic) 

s 

imagery  from  those  associated  with  ordinary  imagery,  we  need  consistent 
means  to  characterize  various  scanpaths.  We  shall  present  the  character- 
ization of  wsual  scanpaths  by  statistical  means  in  Section  III.  Tt 
is  essential  to  understand  the  relation  between  visual  stimuli  and 
the  EEG  signal  for  the  determination  of  the  temporal  cues  that  are  keys 
to  the  encoding  and  retrieval  of  visual  memory.  In  Section  IV,  we 
describe  a nonlinear  oscillator  to  model  the  stimulus-response  relation- 
ship. Many  good  results  have  been  obtained  from  this  model.  The 
presentation  of  visual  stimuli  to  the  subjects  is  an  ever-increasing 
task  in  this  project.  In  Section  V,  we  shall  present  a new  flexible 
method  (GRAF/PEN  system)  for  generating  visual  stimulus  patterns. 

In  closing,  we  shall  make  concluding  remarks  and  describe  future  works 
in  the  last  section. 
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II.  MODELING  AND  PREDICTION 
OF  SACCADIC  EYE  MOVEMENTS 

In  order  to  implement  the  closely-coupled  man-machine  system  for 

visual  memory  enhancement,  it  is  important  to  study  the  saccadic 

movements  of  the  eye  and  to  be  able  to  predict  the  target  point  of  a 

saccade  in  the  shortest  time  possible  after  its  onset.  This  can  help  us 

in  presenting  visual  cues  at  appropriate  times  and  at  the  right  locations 

in  the  visual  field.  To  study  and  analyze  simple  saccades,  we  have 

designed  the  following  experiment: 

A moving  target  in  the  form  of  a plus  (+)  is  presented  on  the  CRT 

screen.  The  target  starts  at  a fixed  point  F on  one  extreme  of  the 

screen  and  then  moves  horizontally  to  one  of  the  six  points  T , 

i = 1 6 , which  are  equidistant  such  that  the  extent  of  eye 

movements  from  F to  T varies  from  5 to  30  . From  T.  , the  target 

l i 

returns  to  F . The  target  remains  stationary  at  each  point  for  1,5 
seconds.  In  one  run,  the  target  goes  through  all  of  the  six  points. 
However,  to  avoid  anticipation,  the  order  is  taken  from  a table  of 
random  permutations.  Twenty-five  such  runs  were  made  during  one  experi- 
ment. Thus,  we  have  records  of  25  saccades  each  of  lengths  from  5°  to 
30°  (only  saccades  from  F to  T are  considered).  The  eye  movements 
are  recon ed  on  analog  tape  and  later  digitized.  Using  an  algorithm 
based  on  the  position  and  velocity  of  the  eye  movements,  the  start  of 
the  saccades  is  determined.  For  each  length,  the  saccades  are  lined  up 
at  this  starting  point  and  averaged.  In  this  way,  we  can  determine  the 
shape  of  a typical  saccade.  The  position,  velocity  and  acceleration  for 
10°  and  15°  saccades  are  shown  in  Figures  1 and  2.  The  vertical  bars 
in  the  position  and  velocity  curves  represent  the  standard  deviation 
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at  each  point. 


The  general  shape  of  these  curves  agrees  with  that  reported  In 
the  literature  [ l] , [2] , [ 3 ] . To  model  the  curves  or  to  use  one  of  the 
existing  models  of  the  saccadic  movement  system  [4], [5], [6]  to  fit  the 
curves  for  prediction  will  be  extremely  useful  for  our  purpose.  We 
will  attempt  to  fit  a parametric  functional  equation  to  the  saccade 
position  curve.  The  relevant  parameters  have  to  be  estimated.  By 
extrapolation  of  this  curve,  we  may  then  predict  the  endpoint  of  the 
saccade. 

In  particular,  let  us  write 


Xi  * £(  V a2 V*k)  + "i 

where  x is  the  eye  position  at  time  t after  the  onset  of  the 
1 1 

saccade,  and  a , ...,  a are  the  parameters  which  have  to  be  estimated 

1 K 

n.  represents  the  noise  term  introduced  by  the  measurement  instrument, 
random  nature  of  the  biological  system,  human  errors  in  taking  data, 
etc.  We  assume  that  the  system  is  stationary  so  that  the  character- 
istics of  n can  be  determined  from  thf  eye  movements  during  fixation 

when  f = 0 . Thus,  the  problem  is  two-fold:  we  first  have  to  choose 
an  appropriate  function  f and  then  to  fit  it  to  the  saccade  position 
curve  in  some  optimum  sense.  We  want  to  estimate  the  parameters  a^ 
as  soon  after  the  onset  of  the  saccade  as  possible.  Prediction  of  the 
endpoint  of  the  saccade  can  then  be  made. 

We  shall  first  assume  that  the  functional  form  of  the  function  f 
is  known  and  shall  consider  only  the  problem  of  estimating  the  parameter 
Our  problem  is  to  find  a , a , ...,  a such  that 
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is  minimized.  They  are  the  so-called  least-squares  estimates.  These 

estimates  coincide  with  the  maximum  likelihood  estimates  ii  n is 

i 

white  Gaussian  noise.  The  least-squares  estimates  are  quite  easy  to 

©vdliicit©  if*  X is  linear  in  t hp  q ic  c . -.u 

in  tne  a.  s.  In  such  a case,  the  minimization 

problem  reduces  to  solving  a set  of  simultaneous  linear  equations. 

The  most  natural  linear  functions  to  consider  are  polynomials. 

However,  as  can  be  seen  from  the  averaged  acceleration  curves,  the  position 

have  points  of  inflection,  which  a low  order  polynomial  will  not 

be  able  to  achieve.  Hence,  we  must  look  at  other,  possibly  non-linear 

functions.  Additional  support  for  the  nonlinearity  of  t comes  from 

the  existing  models  of  the  saccadic  system.  According  to  Robinson's 

model  [5]  of  the  plant  shown  below 
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a saccade  is  produced  by  a pulse-step  input  to  a second  order  system 
with  transfer  function 


T + — 
1 1 s 


(ST  +l)(sT  +1) 


s(sT2+1) 


The  response  of  such  a system  to  a pulse  of  height  h and  durati 

t 
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on  T 


is  given  by 
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From  the  above  expression,  we  found  that  T is  the  time  at  which  the 

velocity  reaches  a maximum.  Thus,  we  can  estimate  the  parameters  h 

and  T from  the  position  curve  for  0 £ t £ T . The  saccade  magnitude 
2 

is  hT  so  that  we  can  predict  it  at  this  time. 

In  general,  a nonlinear  minimization  problem  can  be  solved  by 
first  linearizing  the  function  by  a Taylor  series  approximation  abcu  t 
some  initial  estimates  of  the  parameters  and  then  solving  the  resulting 
set  of  linear  equations  and  updating  the  parameters.  This  iteration  is 
repeated  until  the  desired  accuracy  is  achieved. 
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where  a ,a  . . . . , a,  are  the  initial  estimates  and  . \a  = a - a 

10  20  kt)  j ,j  ,j() 

The  first  order  partial  derivatives  of  f are  assumed  to  exist.  They 
can  be  evaluated  analytically  or  numerically. 

Let 

Ri  = Xi  " ' (aK)’a20 ak0’  ' i) 
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which  now  gives  linear  equations  in  A a . ' s.  Solving  these  equations 
for  .a  j's,  we  can  then  update  the  a ,^’s.  Since  the  above  equation  for 
Os  I S T is  nonlinear  in  only  one  parameter,  a special  method  may 


be  used.  This  method  is  described  as  follows: 


Since 


h / -at 
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Minimizing  S with  respect  to  h , we  obtain 
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and  thus 


h = a 


^xi(°  1 - 1 + :,ti) 
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Setting 


dS  = 0 


(3  a 


to  minimize  S with  respect  to  a , and  substituting  the  above 
expression  for  h in  this  equation,  we  can  then  solve  for  a by  using 
zero-finding  numerical  techniques. 

We  have  used  this  method  for  estimation  of  n aid  a for  actual 
saccades  from  the  experiment  described  before.  The  parameters  are 
estimated  by  using  the  values  of  the  eye  position  for  0 ^ t s T (where 
1 is  taken  as  the  point  of  the  velocity  maxima).  The  parameters  arc- 
then  used  for  predicting  the  rest  of  the  saccade  curve.  In  Figures 
and  -1,  we  show  the  results  in  both  parameter  estimation  and  prediction  o 
the  saccadic  movements  for  two  different  saccades.  These  preliminary 
results  are  encouraging. 

One  aspect  ol  the  saccade  curve  that  this  model  cannot  follow  is 
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the  overshoot  of  the  final  position.  The  second  order  system  is  over- 
damped and  hence  overshoot  will  not  occur.  A remedy  to  this  is  to  use 
the  same  plant  model  but  with  a different  pain  T3  ( T3  ! T ^ in  the 
feed-iorward  path.  Then  the  transfer  function  becomes 


(1+T3s) 

(1+T  s)(l+T  s) 


The  response  is  now  a sum  of  exponentials  and  by  properly  adjusting 
T3  in  relation  to  T , we  can  obtain  the  required  overshoot.  Work 


on  this  model  is  in  progress. 


III.  CHARACTERIZATION  OK  SCANPATHS  BY  STATISTICAL  MEANS 

The  measurement  oi  performance  ol  an  observer  in  visual  memory 
or  visual  search  tasks  is  often  a simple  matter  of  scoring  correct 
answers  or  monitoring  the  time  taken  to  finish  a given  task.  Assessing 
the  reason  why  one  observer  does  better  than  another  is  much  more 
difficult,  and  involves  an  understanding  of  the  strategy  used  by  an 
observer  to  enhance  his  performance  and  an  ability  to  describe  the 
sequence  of  moves  used  to  obtain  the  desired  goal.  In  visual  tasks  the 
sequence  of  fixations  used  in  scanning  the  visual  target  is  called  the 
scanpath,  which  has  been  shown  to  be  an  important  component  of  an 
observer's  performance  [b],[7],[.8].  Thus,  there  is  a need  to  be  able 
to  characterize  the  scanpath,  that  is,  to  be  able  to  describe  features 
of  it  in  terms  other  than  a list  of  (X,Y)  fixation  coordinates. 

One  observation  which  has  often  been  made  is  that  the  fixation 
points  tend  to  be  grouped  around  certain  features  or  areas  of  the 
visual  image,  and  are  relatively  sparse  elsewhere.  Thus,  we  can  measure 
the  nearness  of  one  fixation  point  to  another  and  assign  a similarity 
measure  to  the  two  points  based  upon  this  distance.  The  ability  to 
group  or  cluster  a set  of  fixation  points  is  an  important  step  in 
the  characterization  of  a scanpath,  and  several  different  techniques 
have  been  used  to  measure  point  similarities  and  to  assign  points  to 
clusters. 

A simple  but  useful  measure  of  point  similarity  is  based  on  the 
distance  (d^)  in  degrees  between  fixation  points  p^  and  p 


S 

P 


f 


where  S 

P 


is  the  point  similarity  measure  and  d 


is  a distance-decay 
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constant  which  can  be  chosen  so  that  the  similarity  decreases  at  a rate 


approximately  equal  to  the  decrease  in  visual  acuity  as  a function  of 
distance  from  the  center  of  the  fovea.  Typical  values  for  df  are  4 
or  5 degrees. 

An  extension  of  the  point  similarity  measure  leads  to  a saccade 
similarity  measure.  Let  the  two  sac  cades  to  be  compared  and  s^ 

have  starting  and  ending  point  p , P2a  . and  Plb  > P2b  * Defl 


that  is,  the  saccade  similarity  is  the  product  of  the  similarity  between 
starting  and  ending  points  of  the  saccades.  This  measure  has  ccitain 
properties  that  make  it  very  suitable  for  comparing  two  saccades: 

•S  for  identical  saccades  is  one. 
s 

•S  for  very  different  saccades  is  near  zero, 
s 

•As  the  difference  between  two  saccdes  increases,  the  similarity 
measure  drops  from  one  and  approaches  zero. 

•S  is  sensitive  to  the  direction  of  the  saccadic  Jump, 
s 

•Unlike  a vector  dot  product,  absolute  position  is  relevant. 

We  have  used  this  saccade  similarity  measure  on  scanpath  data 
consisting  of  several  scans  of  a given  scene  by  an  observer.  The 
saccades  were  compared  pairwise  and  only  those  pairs  of  saccades  with 
similarities  greater  than  a certain  threshold  were  retained.  The 
resulting  plot  of  saccades  (Figure  5 ) clearly  showed  those  transitions 
which  were  most  likely  and  which  occurred  often.  Thus,  the  saccade 
similarity  measure  is  a simple  and  effective  mechansim  for  deteimining 
the  most  frequently  traversed  paths  followed  by  the  eyes  in  viewing 
a picture. 
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In  addition  to  the  above  use  of  the  similarity  functions,  we  have 
developed  an  automatic  method  for  determining  if  a given  scanpath  is 
cyclical  or  repeating  in  nature.  By  systematically  comparing  each 
saccade  in  a scan  with  its  nearest  neighbor,  then  next-nearest  neighbor, 
and  so  on,  and  summing  the  similarity  measures  at  each  displacement,  we 
compute  an  "autosimilarity"  function  of  saccades  which  is  very  much  like 
an  autocorrelation  function  for  a time  series.  Any  cyclical  componenets 
in  the  scan  will  appear  as  peaks  in  the  autosimilarity  function.  The 
distance  between  peaks  indicates  the  period  (number  of  saccades)  of  the 
cycle.  Figure  6 is  a graph  of  the  autosimilarity  function  for  a scan 
having  a pronounced  cyclical  tendency.  In  the  same  way,  it  is  possible 
to  derive  a cross-simi.larity  function  for  two  different  scans. 

There  exists  an  alternative  approach  to  characterizing  scanpaths, 
and  it  is  based  on  the  following  two  assumptions: 

(a)  There  are  a discrete  number  of  "fixation  centers"  in  the  scene 
being  viewed  and  each  fixation  point  in  the  scan  can  be 
assigned  to  one  of  the  fixation  centers.  This  process  of 
assignment  is  often  called  "clustering".  The  center  of  the 
clusters  should  be  in  close  agreement  with  the  centers  of 
fixation.  Due  to  the  random  nature  of  the  fixation  points,  in 
any  repetition  (cycle)  of  the  scannath,  the  fixation  points 

do  not  always  coincide. 

(b)  A scanpath  then  becomes  a sequence  of  transitions  from  one 
cluster  center  to  another.  Any  saccade  with  starting  and 


ending  points  in  the  same  cluster  is  discarded. 


Figure  6 Autostmi larity  plot  lor  a single  scanpath 
Peaks  indicate  cyclical  property  ol  the  scanpath. 
The  distance  between  peaks  is  the  number  of 
saccades  in  the  cycle. 
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1 rom  the  set  o t all  saccades  leaving  a given  cluster  center  we  can 
lind  the  transition  or  transitions  which  have  the  highest  probability. 
These  transitions  are  termed  the  "most-probable-saccades".  The  "most- 
probabie-scanpath  is  then  defined  to  be  the  set  of  all  most-probable- 
saccades.  The  most-probable-scanpath  depends  on  how  the  clusters  are 
chosen,  and  is  not  necessarily  a closed  path  through  the  cluster  centers 
Its  usefulness  is  that  it  concisely  summarizes  the  most  important 

aspects  of  the  scanpath  used  by  the  observer  in  viewing  the  given  visual 
target . 

We  have  used  two  different  algorithms  for  selecting  cluster  centers 
each  with  its  own  particular  advantages  and  disadvantages.  These 

algorithms  are  known  as  ' ISODATA"  and  "Minimum-Spanning-Tree-Clustering" 
or  MSTC. 

In  the  ISODATA  method  [9]  the  number  of  clusters  desired  is  given 
as  an  input  variable,  and  the  algorithm  partitions  the  fixation  points 
into  subsets  such  that  the  total  distance  between  the  fixation  points  in 
a cluster  and  the  cluster  center  is  minimized  for  all  clusters.  The 
cluster  center  starting  points  are  usually  selected  randomly,  and  the 
algorithm  keeps  moving  the  cluster  centers  until  the  above  criterion 
has  been  reached. 

The  MSTC  algorithm  [lO]  automatically  determines  the  number  of 
clusters  in  the  data  and  assigns  fixation  points  to  the  clusters.  Three 
variables  given  as  input  may  be  adjusted  to  change  the  criteria  by  which 
clusters  are  selected. 

The  chief  advantages  or  disadvantages  of  these  two  algorithms  are 
summarized  below: 
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(1)  Acquires  the  desired  number  of  clusters,  which  usually  is  not 

(2)  Solutions  often  are  not  unique,  but  vary  with  starting  conditions. 

(3)  1 he  iterations  can  require  a substantial  amount  oi  computing. 

H)  Many  points  can  be  easily  accommodated. 

MSTC 

m The  solution  is  unique,  and  the  number  of  clusters  is 
automatically  determined. 

(2)  The  computation  is  quite  fast. 

(3)  Many  points  requires  a large  amount  of  storage. 

figures  7 and  8 illustrate  how  the  second  of  these  algorithms 
(MSTC)  may  be  employed  to  reduce  scanpath  data  to  a more  concise  form, 
figure  , is  a graph  of  a scanpath  superimposed  upon  a line  drawing- 
representing  the  still  life  scene  which  the  observer  was  viewing.  The 
first  recorded  fixation  (1)  is  in  the  center  of  the  picture  to  the 
right  ol  the  label  of  the  righthand  wine  bottle.  The  last  fixation  (70) 
is  in  the  lower  righthand  position  of  the  picture.  The  viewing  time 
required  to  create  this  scan  totaled  20  seconds.  Figure  8 represents 
the  same  data  after  processing  by  the  MSTC  program.  The  program 
partitioned  the  fixation  points  into  23  subsets  or  clusters  (using  certain 
criteria  supplied  by  the  programmer)  and  then  computed  the  most  likely 
transitions  from  cluster  to  cluster.  Clusters  containing  only  one 
fixation  point  were  ignored.  The  resulting  plot  shows  the  most  likely 
saccades  between  areas  containing  large  numbers  of  fixations,  and  presents 
the  original  data  in  a highly  condensed  format.  These  preliminary  results 
are  very  promising.  Refinements  of  this  method  are  in  progress. 
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IV.  MODELING  OF  EEG  SIGNALS  DURING 
PERIODIC  PHOTIC  STIMULATION 

1 . IntrocHiet  ion 

To  bettor  understand  the  relation  between  visual  stimuli  and  the  EEG 
signal,  we  have  used  a nonlinear  oscillator  to  model  the  stimulus-response 
relationship.  In  particular,  wc  are  studying  the  entrainment  of  the  alpha 
rhythm  by  periodic  photic  stimuli.  This  will  enhance  our  understanding 
ol  the  effect  on  EEG  signals  exerted  by  the  repetit  ve  photic  stimulation 
and  the  various  degrees  of  efficiency  of  the  stimulus  falling  on  various- 
phases  of  the  EEG  signal.  Them  is  every  reason  to  believe,  based  on 
the  results  of  other  researchers,  that  the  eye  takes  in  information  only 
when  it  is  fixating.  One  of  our  goals  is  to  guide  the  eye  to  fixate  only 
at  those  instances  corresponding  to  the  EEG  phases  while  the  brain  is 
in  the  best  state  for  processing  information.  We  believe  that  there 
are  relations  between  the  effective  phases  for  stimulation  and  the  optimal 
phases  for  fixations.  It  is  hoped  that  the  development  of  a model  for 
the  entrainment  process  will  elucidate  the  behavior  of  the  alpha 
frequency  and  phase,  and  thus  lead  to  a more  practical  brain  state 
estimator  and  predictor  in  our  memory  studies. 

Significant  results  have  been  obtained  from  the  nonlinear  oscillator 
mode!.  A time-domain  method  of  analysis  for  a pulse-train  driven  van 
dor  Pol  oscillator  was  developed,  and  the  resulting  predictions  were 
supported  by  new  EEG  data  collected  from  several  subjects.  Wc  will 
present  the  analysis  along  with  model-generated  results  from  a digital 
computer  and  compare  with  EEG  results  from  human  subjects. 
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-•  A Nonlinear  Mathematical  Model  for  Kn trainmen t of  EEG  Signals  by 
Periodic  Photic  Stimulation 

The  model  is  a van  der  Pol  oscillator  representing  the  behavior  ol 
a subject's  EEG  during  periodic  stimulation  by  a stroboscope.  The  flashes 
are  delivered  for  20  seconds  at  some  fixed  frequency,  followed  by  a 20 
second  stimulus-off  period.  This  sequence  is  repeated  for  each  desired 
stimulus  frequency. 

1 he  van  der  Pol  oscillator  can  be  represented  by 

/ 2 \ • 2 2 
x - p 1 1 - x J x f «J()x  = E ( t ) 

where  x(t)  denotes  the  EEG  signal*,  is  the  unstimulated  alpha 

frequency;  E(t)  is  the  external  excitation  (stimulus);  and  p is  the 
nonlinear  coupling  coefficient. 

A first  approximation  to  the  solution  x(t)  is  readily  made  when  E(t) 
is  a sinusoid,  as  discussed  in  the  previous  report,  and  the  results  in  fact 
predict  quite  well  our  experimental  data.  However,  since  the  experimental 
stimulus  is  a train  of  flashes,  we  have  developed  an  analysis  technique 
tor  approximating  the  solution  of  the  van  der  Pol  equation  when  E(t)  is 
a pulse  train. 

We  assume  that  the  unperturbed  oscillation  (E(t)  = 0)  is  correctly 
represented  by 

x(t)  = a sin  0(t) 

where  the  angular  displacement  can  be  written  in  terms  of  frequency  and 
phase : 

0 ( t ) = .Qt  : <t> 

W'e  wish  to  examine  the  result  of  E(t)  being  a series  of  impulses  of 
strength  q at  a frequency  u,  . 


Following  a method  iluc  to  Bluequtere,  wo  can  assess  the  perturbation 


caused  by  one  intpluse.  At  an  angular  displacement 

U t . 6 

n ti  n 

we  apply  tin-  nth  impulse.  Its  e I Tec t will  be  seen  directly  in  x(t)  , 

•) 

causing  a small  step  change  x q over  time  t . However,  x will 

be  continuous,  so  x <). 

To  a iirst  approximation,  we  can  expand  x and  .x  as  below: 


x 


. x 


a sin  • a 0 cos  0 0 

n 0 n 


a cos  0 
0 n 


tt  6 s t n 

0 0 


n 


where  ..a  represents  t lie  change  in  amplitude  and  \6  represents  the  change 
in  phase  oi  the  system.  Solving  simultaneously  lor  ,\a  aud  \<t>  , we  obtain 

a t,  ()  cos  J t 

“■«) 

6 - S 1 II  o . 


In  Figure  I),  we  demonstrate  the  amplitude*  and  phase  perturbat  ions' as 
a result  ol  an  impulse  1'alling  on  angular  displacement  P . 


a a n 

1 i gitre  H Phase  and  n 

Amplitude  Perturbat  ions 


The  unperturbed  solution  would  have  followed  the  dashed  line,  and 
the  perturbed  solution  follows  the  solid  line. 

In  order  to  deal  with  a series  of  these  impulses,  Aa  will  be 
assumed  to  be  negligible.  This  is  reasonable  since  a more  detailed  analys 
shows  that  the  amplitude  change  decays  exponentially  with  time.  Lei 


T = 


2it 


0 u) , 


0 

2n 


T,  = 

1 t*j 


be  the  alpha  and  stimulus  periods,  respectively.  Then  referring  again  to 
Figure  9,  we  see  that  applying  the  nth  pulse  at  displacement  9 results 
in  a new  displacement  0^  . Since  the  pulses  are  spaced  T^ 

seconds  apart,  the  (n+l)th  pulse  will  arrive  at  displacement 


0 , = 0 + A6  (0  ) + T. 

n+1  n \ n/  1 


Clearly,  for  entrainment  to  occur,  we  must  have 


M 


mod  T 


M 


0 


mod  T 


0 


or 


Hence 


fa  + A*(e  ) + t,1  = [a  1 

L n ' ‘J  mod  T0  L "J 


mod  T 


0 


A 


4>(en ) + Tx  = k T0  • k = °>  i.  2 


When  k=0  , we  have  the  unlikely  situation  of  resetting  the  phase  of 
oscillation;  the  required  phase  change  A<t very  large.  We  will 
not  consider  this  case  here. 
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lor  k - 1 , the  solution  is  called  harmonic  entrainment,  and  lor 
k r?  2 , it  is  called  k^'-order  superlnirmon ic  entrainment,  where  k represents 
the  number  of  alpha  periods  elapsed  per  stimulus  implusc.  It  is  ea  ;y  to 
show  that  this  is  stable  near 


as  one  would  expect  from  the  l'onn  of  . 

In  a similar  fashion,  for  subharmonic  entrainment  to  occur, 

L nh,,J  mod  T 
or 

U 1 111-1  \ 

0 t V .\6(U  ) i m T 
n ' i'  1 

i=n 

Hence, 

nlm-1  . > 

L M°i)  1 m Ti ; T„  • 

i = n 

When  m = 1 we  have  harmonic  entrainment,  again,  and  lor  m 2:  , m^*1- 

order  subharmon ic  entrainment  occurs.  The  stability  ol  this  solution 
is  currently  belt’,'!:  investigated,  but  it  appears  that  for  m = 2 a 
small  stable  ran^e  exists. 

In  summary,  when  the  stimulus  frequency  is  near  the  alpha  frequency, 
harmonic  entrainment  is  possible.  When  the  nlphn  frequency  is  near  an 
integer  multiple  of  the  stimulus  frequency,  superhnrmonic  entrainment 
is  possible.  And  when  the  s 1 imtilus  frequency  is  near  an  integer  multiple 
of  the  alpha  frequency,  subharmon i c entrainment  is  possible. 

When  the  stimulus  frequency  is  not  in  one  of  the  above  ranges,  combined 
frequency  oscillations  exist.  This  can  be  easily  seen  by  considering  the 


.[u 

1 

mod  T 

l 

n J . 

mod 

spectrum  of  a sinusoid  with  perturbations  at  some  other  frequency.  l'lic 


r -»■■.  ,'i'  f <■*  >.  w/.«w*w»Myiivi  r,  ■■  « « ,(11  WJinf.  IA I W 1 1 J yu  f l!  “I  I IUHIW1JI,'  WWWffJHWf!'-  -, 


spectrum  will  have  components  at  the  stimulus  frequency  and  its  integer 
harmonics  in  addition  to  the  autonomous  component.  We  also  expect 
similar  harmonics  to  be  present  during  the  existence  of  entrainment. 
Results  obtained  from  EEG  data  and  the  model  are  described  and  compared 
in  the  next  section. 

3.  Theoretical  Predictions  and  Comparison  of  Results 

In  Figure  10  an  entire  experimental  record  is  presented.  Each 
curve  represents  an  integrated  spectrum  of  the  EEG  taken  over  the  entire 
20-second  stimulus-on  period.  A new  stimulus  frequency  is  used  for 
each  stimulus-on  period.  The  horizontal  axis  is  in  hertz  for  all  the 
spectrals,  and  the  vertical  axis  may  be  considered  to  be  the  stimulus 
frequency  as  it  is  varied  throughout  the  experiment.  Starting  from  the 
bottom,  the  stimulus  starts  at  10  Hz.,  drops  to  .5  Hz.,  rises  to  20 
Hz.,  then  drops  back  to  10  Hz.  at  the  top.  The  stimulus  frequency  is 
changed  by  .5  Hz.  for  each  new  spectral.  The  five  effects  predicted  in 
the  previous  section  are  visible  in  Figure  10:  harmonic  entrainment, 

superharmonic  entrainment,  subharmonic  entrainment,  combined  frequency 
oscillations,  and  stimulus  harmonics. 

The  van  der  Pol  model  has  been  simulated  on  a PDP-15  computer  as 
described  in  the  previous  report.  W e will  present  some  direct  comparisons 
between  the  EEG  spectra  and  the  spectra  generated  by  the  model.  The 
straight-line  spectra  are  the  model-generated  predictions,  and  the 
smooth-curve  spectra  are  EEG  results  taken  from  the  record  in  Figure  10. 
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Figure  11  shows  the  situation  with  no  stimulus  applied;  u^/ 2tt  is 
adjusted  to  9.7  Hz.,  the  subject's  alpha  frequency.  Figure  12  shows 
harmonic  entrainment  very  close  to  the  alpha  frequency;  note  the 
harmonics.  Harmonic  entrainment  is  again  seen  in  Figure  13.  In  Figure 
14,  second-order  superharmonic  entrainment  can  be  seen;  the  alpha  rhythm 
has  shifted  to  twice  the  stimulus  frequency.  Figure  15  shows  second- 
order  subharmonic  entrainment.  This  particular  simulation  is  quite 
unstable  (as  expected)  and  is  currently  being  investigated.  Combined 
frequency  oscillations  can  be  seen  in  Figures  16,  17,  and  18.  Note  the 
high-order  stimulus  harmonics  in  Figure  18.  In  Figure  19,  we  see  that 
the  stimulus  occurs  so  infrequently  that  there  is  no  discernible 
effect  on  the  EEG  spectrum,  as  one  would  predict  from  the  previous 
analysis. 

The  experimental  data  exhibit  the  major  frequency  domain  phenomena 
predicted  by  the  model;  we  believe  this  is  a significant  step  toward 
the  understanding  of  some  aspects  of  the  alpha  rhythm  in  EEG.  Work  is 
currently  in  progress  to  improve  the  model  simulation,  and  investigations 
into  the  time-domain  predictions  of  the  model  have  been  initiated.  T’e 
analysis  of  the  model  in  a previous  section  suggests  the  existence  of 
some  rather  interesting  EEG  phase  phenomena,  which  we  feel  will  have 
direct  bearing  on  the  timing  of  eye  fixation.  It  is  anticipated  that 
this  nonlinear  model  will  provide  a good  basis  for  prediction  of  cortical 
states  needed  for  our  memory  studies. 
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Figure  17 

EEG  and  simulated  spectra  during 
11.0  Hz.  stimulation. 
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V.  GRAF/PEN  SYSTKM  FOR  G ESK RATING  VISUAL,  S'l'lMl  LUS  PATTE RN S 

As  our  work  progresses,  the  need  lor  the  capability  to  generate 
a variety  of  visual  stimulus  patterns  in  a convenient  way  increases. 

The  GRAF/PEN  system  enhances  precisely  tliis  needed  capability. 

The  GRAF/PEN  digitizer  (Science  Accessories  Corporation  Model  GP-P) 
consists  of  a spark  pen,  writing  tablet,  an  orthogonal  set  of  strip 
microphones,  and  electronic  accessories.  Figure  20  shows  the  hardware 
of  this  system.  The  X and  Y coordinates  of  t lie  pen  are  derived  from 


Figure  20  GRAF/  PEN  unit  with  spark  pen, 
writing  tablet,  strip  mic ropliones , 
and  electronic  accessories. 

the  1 light  travel  times  ol  the  sound  of  sparks  initiated  al  the  pen  tip 


electric  voltages  thus  generated  are 


led  to  t lie  PDP-11  through  an  inter 


face.  The  unichannel  operating  system  for  the  PDP-11  called  PI  REX  has  been 
slightly  modified  to  respond  and  read  the  coordinates  from  the  interface 
and  load  them  into  designated  locations  in  core.  An  event  variable  is 
then  set  in  a manner  consistent  with  the  overall  RSX-III  operating  system. 
Each  spark  whether  automatic  or  manually  generated,  initiates  this  process. 

A program  dubbed  "DRAW"  has  been  developed  and  implemented  for  the 
purpose  of  utilizing  the  GRAF/PEN  digitizer  to  generate  visual  stimulus 
patterns  more  conveniently  for  various  experiments.  By  employing  two 
subroutines,  the  "DRAW"  program  constructs  a file  which  consists  of 
various  picture  segments  made  up  of  groups  of  points.  Various  commands 
such  as  DRAW,  ERASE,  LXX'AT'' , DISPLAY,  SCALE,  and  END  have  been  designed 
for  the  user  to  create  and  manipulate  these  files. 

The  basic  data  structure  consists  of  picture  segments  as  shown  in 
Figure  21.  The  -999  indicates  the  beginning  of  a segment.  The  header 
length  word  indicates  the  length  of  the  header  to  follow.  This  header 
is  meant  to  hold  information  for  classifying  the  succeeding  picture 
segment  in  such  a way  that  selective  retrieval  and  display  can  be 
easily  performed.  The  header  was  designed  to  be  of  variable  length  so 
as  to  allow  for  future  enhancements.  The  end  of  a picture  file  is 
signified  by  -111. 

The  "DRAW"  software  is  designed  as  a man-machine  interactive  program. 
When  the  program  DRAW  is  first  requested,  it  asks  for  a picture  file 
name.  The  user's  replay  will  prompt  the  machine  to  ask  whether  the 
user  wishes  to  append  picture  segments  to  an  old  file  by  this  name.  If 
the  user  does  not  wish  to  append,  then  a new  file  will  Le  created.  The 
program  will  then  wait  for  picture  commands.  The  user's  commands  are 
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figure  21  Data  structure  for  picture  segments  and  files. 


entered  via  a menu-type  scheme  using  the  GRAF/FEN  tablet.  The  lower 
right  hand  corner  of  the  writing  tablet  is  designated  as  the  command 
section.  Particular  areas  in  this  section  correspond  to  various  commands. 
The  function  of  each  command  is  described  as  follows: 

"LOCATE"  is  a command  which  will  map  points  on  the  GRAF/PEN  tablet 
to  corresponding  points  on  a 611  Tektronics  oscilloscope  display.  This 
allows  the  user  to  locate  the  picture  points  already  on  the  display  in 
relation  to  the  pen  location  on  the  tablet. 

The  "DRAW"  command  constructs  a picture  segment.  It  first  enters 
a -999  which  indicates  the  beginning  of  a segment  and  then  the  header 
length.  Any  previously  entered  header  information  will  then  be  inserted. 
Successive  point  are  read  from  the  GRAF/PEN  until  another  command  is 
encountered.  These  data  points  are  analyzed  spatially  as  they  are 


enetered  into  the  file.  Points  within  a certain  distance  of  each  other 
are  discarded  so  as  to  prevent  bunching  and  wasteful  redundant  information. 
An  operation  similar  to  LOCATE  is  used  to  display  the  points  that  are 
stored  on  the  611  scope.  This  enables  the  user  to  monitor  the  progress 
of  his  drawing. 

"DISPLAY"  will  cause  the  display  of  all  the  picture  segments  which 
have  previously  been  generated.  It  automatically  extrapolates  between 
successive  points  in  a segment.  The  displayed  picture  can  be  plotted 
on  either  the  611  storage  scope  or  CalComp  plotter.  Figures  22  and  22 
show  such  an  example* 

"ERASE"  will  cause  the  deletion  of  either  the  last  twenty  points 
or  up  to  the  previous  picture  segment,  which  ever  occurs  iirst.  It 
also  crosses  out  the  points  which  have  been  erased  on  the  611  scope  so 
as  to  allow  the  user  to  examine  what  portion  has  been  actually  erased. 

An  example  is  shown  in  Figure  24. 

"SCALE"  will  determine  the  mapping  from  the  GRAF/PKN  tablet  (4096 
a 4096  raster  units)  to  the  611  scope  or  CalComp  plotter  (1023  1023 

raster  units).  Most  linear  mappings  such  as  horizontal  and  vertical 
gain,  rotation,  horizontal  and  vertical  offset,  and  skew  can  be  handled 
with  ease.  The  coordinate  space  of  the  mapping  is  defined  bv  three 
points;  viz.,  the  endpoint  of  the  Y axis,  the  origin,  and  the  endpoint 
of  the  X axis.  This  mapping  is  performed  whenever  "DRAW'  , ' ERASE  , 
"LOCATE",  and  "DISPLAY"  were  actuated. 

The  "END"  command  will  close  the  picture  file  and  transform  it 
into  a disk  file.  The  system  is  also  reset  by  this  command. 

The  "DRAW"  program  can  presently  handle  picture  files  of  up  to 
128,000  points  partitioned  in  any  number  of  segments.  A primitive 
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virtual  memory  mechanism  was  implemented  to  handle  efficiently  such 
large  files.  The  actual  program  was  written  in  a modular  form  so  that 
any  future  modifications  and  expansion  can  be  done  with  the  least 
effort.  The  "DRAW"  software  has  greatly  enhanced  our  capability  to 
produce  pictorial  stimulus  patterns. 

We  have  also  modified  the  "SEEK"  program,  which  was  designed  for 
visual  scanpath  study.  The  progran  enables  us  to  analyze  the  scanpath 
in  the  domain  of  the  "distorted"  picture;  i.e.,  the  recorded  data  from 
the  eye-movement  monitor  as  a subject  views  a "SEEK"  picture.  In  order 
to  have  the  distorted  picture  correspond  more  closely  to  the  original 
picture,  a routine  has  been  added  to  the  "DRAW”  software  which  allows 
simple  scaling  and  offsetting  of  the  response  data  so  that  the  size 
and  placement  of  the  distorted  picture  more  closely  approximates  the 
original  stimulus  pattern.  The  only  distortion  then  remaining  is 
the  result  of  nonlinearities  in  the  eye-movement  monitor  and  noise  in 
the  system.  As  a result,  feature  identification  and  the  location  of 
the  subject’s  visual  attention  on  the  picture  may  be  made  in  the  distorted 
picture  domain. 

The  "ADJUST"  routine  draws  the  current  picture  on  both  the  main 
and  remote  611  scopes,  then  digitizes  EMM  location  data  and  displays 
a "+"  on  the  main  611  scope  screen  corresponding  to  the  location 
of  the  subject's  visual  attention.  By  adjustment  of  two  sets  of  scaling 
anf  oflset  amplifiers  (one  set  for  each  of  the  X and  Y directions), 
as  the  subject  looks  from  point  to  point  at  the  drawn  picture,  the 
response  d ita  may  be  adjusted  to  correspond  in  size  and  locat ion  to 
the  stimulus  picture.  When  the  progrant  exits,  scaling  and  offset 
constants  are  computed  which  allow  the  operator  to  return  to  the 

4-1 


* "I*  f J.  W w ' 1 V- 


raw  data  to  mi  if  desired 

In  addition,  in  the  VIEW  mode  oi  operation,  the  response  data  is 
displayed  or  the  main  611  scope  as  the  subject  views  the  picture  on 
the  remote  scope.  Thus,  the  operator  may  determine  if  the  adjustment 
is  sufficiently  accurate  for  the  analysis  to  be  done. 

The  problem  of  visual  overshoot  on  the  part  of  the  subject,  when 
an  abrupt  change  of  direction  occurs  in  the  stimulus  picture,  has  been 
m "imized  by  the  addition  of  a "slow  down"  routine  for  the  VIEW  mode 
of  operation.  A SEElt  picture  file  is  prepared  for  this  application 
by  the  program  SPEED  which  inserts  a delay  count  at  the  location  of  a 
change  in  direction  of  the  p 1 c < are.  The  amount  of  delay  and  the  thres- 
hold magnitude  for  the  change  of  direction  is  determined  by  operator 
responses  to  questions  on  the  VTpa.  Thus,  the  speed  at  which  the 
picture  is  drawn  slows  down  at  the  areas  of  rapid  change  in  direction, 
and  the  subject  has  less  of  a tendency  to  overshoot  that  change  in 
direction. 

As  an  improvement  in  the  speed  at  which  SEER  responds  to  commands 
to  fetch  and  store  picture  files,  all  picture  files  are  now  stored  in 
their  binary  rather  than  symbolic  form;  additionally,  less  storage 
space  is  required  on  the  disk  for  pictures  in  their  binary  form. 
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VI.  CONCLUSION 


7 

/ 

Our  work  has  boon  progressing  along  the  lines  as  proposed.  aJ 
reported,  we  have  developed  models  for  saddadic  eye  movements  and  KKC 
signals  with  the  aim  of  developing  better  techniques  for  tracking  and 
prediction  of  eye  positions  and  cortical  states.  With  the  continuously 
up-dated  information  concerning  the  eye  position  and  cortical  sta^e  for 
adjusting  the  stimulus  parameters  and  the  tracking  and  prediction 
techniques,  we  will  then  be  able  to  guide  the  eyes  to  fixate  at  optimal 
locations  and  at  optimal  time  instants  such  that  the  vividness  and 
persistence  of  the  desired  after-image  is  enhanced.  Hopefully,  the 
KEG  model  will  also  provide  a better  assessment  of  its  role  as  a timing 
mechanism  in  processing  visual  information.  This,  in  turn,  will  aid 
us  in  determining  these  optimal  time  instants.  The  study  of  visual 
scanpaths  for  the  purpose  of  differentiating  scanpaths  associated 
with  superior  memory  from  those  associated  with  ordinary  memory  will 
give  us  a firmer  grip  in  the  establishment  of  optimal  locations  for 
the  eyes  to  fixate  and  the  optimal  scanning  sequence  for  the  eyes. 

1 °r  this  Pul’Pos°,  a better  grip  and  consistent  characterization  of 

visual  scanpaths  are  necessary.  To  this  end,  we  have  developed  statis- 
tical means  for  the  characterization  of  visual  scanpaths.  We  have  also 
developed  and  mplemented  a man-machine  interactive  system  for  generating 
visual  stimulus  patterns.  Our  immediate  task  is  to  determine  those 
optimal  locations  and  optimal  time  instants  mentioned  previously. 

Esing  this  information,  we  shall  attempt  to  devise  real-time  strategies 
lor  the  control  of  visual  pattern  impression  and  visual  image  (memory) 
persistence  and/or  recall  ability  to  close  the  feedback  loop  in  our  desig 
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o 1 th0  closely-coupled  man-machine  system  to 
and  training. 


r visual  memory  tracking 


In  this  report  and  also  in  various  conference 
presented  our  accomplishments  and  results  to  date, 
outlined  are  in  progress. 


papers,  we  have 


Further  works  as 


UMiUT’  ''  -•■ ." -M», .■.',- ,-*LP W l UfW1  " •” 


RK  l-'KItKNCKS 


Hyde,  ,J.  K.,  "Some  Characterisi  tics  of  Voluntary  Human  Ocular 
Movements  in  the  Horizontal  Plane",  Anier.  Journal  of  Ophthal. 

1959,  -18,  85-9-1.  “ 

Wes thoimer,  G.,  "Mechanism  ol  Saccadic  Kye  Movements",  Arch. 

Ophthal.  , 195-1,  52,  710-72-1. 

Yarbus , A.  1,.,  Kye  Movements  and  Vision,  New  York:  Plenum  Press,  1967. 

^ ounR , L.  R. , 1-orster , J.  1).,  and  Van  lloutte,  N.,  "A  Revised 
Stochastic  Sampled  Data  Model  for  Rye-Tracking  Movements", 
fourth  Annual  NASA-liniv.  Conference  on  Manual  Control,  University 
of  Michigan,  Ann  Arbor,  Michigan,  1968. 

Robinson,  D.  A.,  Progress  ir  Models  of  Rye-Movement  Control", 

Proc.  Int'l  Conference  or  Cybernetics  and  Society,  1972,  1-1 -2-1. 

Robinson,  D.  A.,  Models  oi  the  Saccadic  Rye-Movement  Control 
System" , Kybernetic,  1973,  1-1,  71-83. 

No  ton , D.,  "A  Theory  of  Visual  Pattern  Perception",  IREK  Trans. 
on  Systems  Science  and  Cybernetics,  Oct.  1970,  SSC-6,  -1  , 

349-357. 

Noton,  D. , and  Stark,  L. , Scanpaths  m Saccadic  Kye  Movements 
While  Viewing  and  Recognizing  Patterns",  Vision  Research, 

1971,  11,  929-3-12 . 

Duda,  R.  0.  and  Hart,  P.  I,'.,  Pattern  Classification  and  Scene 
Analysis,  New  York:  -I.  Wiley,  1973,  p . 203.  ~ 

Page,  R.  L. , Algorithm  179,  Collected  Algorithms  ol  the  ACM. 


18 


m 


...  . 


LIST  OK  PUBLICATIONS 


[1] 


[2] 


A.  Shah  and  I).  C.  Lai,  "Computer  Determination  of  Lye  fixations 
and  Saccadcs  , presented  at  the  27th  Annual  Conference  on 
engineering  in  Medicine  and  Biology,  Philadelphia,  Penn. 
October  6-10,  1971,  and  published  in  the  Proceedings,  p.'l()3 


r rrr?’  ' * L:U’  anfl  * K*  Anlikcr>  "A  Nonlinear  Model 

of  LKG  entrainment  by  Periodic  Photic  Stimulation",  presented 

at  the  Seventh  Annual  Conference  of  the  Neuroelectric  Society 
New  Orleans,  La.,  November  20-23,  1974,  and  published  in  the 
Proceedings,  np.  13-14. 


[:;]  11.  s.  Magnuski,  "Remark  on  Algorithm  479[/.]",  has  been  accepted 

lor  publication  in  the  December  issue  of  Communications  of  the 
Association  for  Computing  Machinery.  ~ 


U!  A'  ““  “•  A'’Pkc'-’  "Prcaicliw.  or  HUG  Waveforms 

b.  I stag  Autoregressive  Model",  has  been  accepted  for  presentation 
at  the  197 f>  San  Diego  Biomedical  Symposium  and  scheduled  for 
publication  in  its  Proceedings. 


[5] 


D • C . La  i , 4 . 
Stimulation 
publ icat ion 


. Anliker,  and  R.  V.  Lloyd,  "The  Effect  of  Photic 
in  Human  LEG  Signals'  , submitted  to  IKLK  for 


